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Abstract 

We consider nonequilibrium systems such as the Edwards- Anderson Ising spin glass 
at a temperature where, in equilibrium, there are presumed to be (two or many) broken 
symmetry pure states. Following a deep quench, we argue that as time t — > oo, although 
the system is usually in some pure state locally, either it never settles permanently on 
a fixed lengthscale into a single pure state, or it does but then the pure state depends 
on both the initial spin configuration and the realization of the stochastic dynamics. 
But this latter case can occur only if there exists an uncountable number of pure states 
(for each coupling realization) with almost every pair having zero overlap. In both 
cases, almost no initial spin configuration is in the basin of attraction of a single pure 
state; that is, the configuration space (resulting from a deep quench) is all boundary 
(except for a set of measure zero). We prove that the former case holds for deeply 
quenched 2D ferromagnets. Our results raise the possibility that even if more than one 
pure state exists for an infinite system, time averages don't necessarily disagree with 
Boltzmann averages. 

KEY WORDS: spin glass; nonequilibrium dynamics; deep quench; stochastic Ising model; 
broken ergodicity; coarsening; persistence; damage spreading. 



1 Introduction 

In this paper we study nonequilibrium dynamics of spin systems. While our approach is 
general, and covers both ordered and disordered, Ising and non-Ising systems, in the presence 
or absence of a magnetic field, we will for specificity here focus mostly on the dynamics of 
the Edwards-AndersonB Ising spin glass in zero field. We make no assumptions about the 
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real- or state-space structure of the low-temperature spin glass phase, but instead derive 
several general principles and then explore their consequences. 

Our results indicate that equilibrium pure state structure plays an important role in 
nonequilibrium dynamics. E.g., we will show that (at fixed temperature) a system with 
many pure states may have very different dynamical behavior than one with only a single 
paiiQ - - so nonequilibrium dynamics can serve as an important probe of the equilibrium 
pure state structure. 

That the number of and relationships among pure states can affect nonequilibrium dy- 
namics may seem surprising in light of a general supposition (see, for example, Refs. f|], 
and many of the references therein) that the time evolution of an infinite system is confined 
within a single pure state for all finite times. A consequence of this supposition is the preva- 
lent notion that, if there exists at some temperature T more than one pure state (e.g., due to 
broken symmetry), then necessarily the limits t — > oo (time) and N — > oo (system size) do 
not commute (when, say, measuring the state of some observable) . An equivalent statement 
is that time averages (as performed in the lab) and Boltzmann averages (as performed on 
paper or the computer) will give differing results. (One proposal® for avoiding this problem 
in theoretical treatments of spin glass dynamics is to start with a Boltzmann distribution 
of initial configurations, rather than a single one.) We will argue, however, that these are 
not necessary consequences of broken symmetry or multiple pure states; they may be true 
in some cases, but not in general. We examine here in which contexts they are true and 
in which they are not|. We begin by constructing dynamical probability measures on spin 
configurations, which will enable us to clarify notions such as time evolution within a pure 
state. 

2 Dynamical Measures 

We will mostly, but not exclusively, consider the EA Ising spin glass in zero field. Its 
Hamiltonian is given by: 



where the sites x,y 6 Z and the sum is taken over nearest neighbors only. The couplings J xy 
are independent random variables, whose common probability density is symmetric about 
zero; we let J denote a particular realization of the couplings. 

1 We emphasize that we are talking here about the equilibrium pure states present at the temperature at 
which the dynamics is observed, as distinguished from the proposal (see, e.g., Ref. [^2|) that metastable states 
with O(l) free energy barriers affecting dynamics at a given temperature are the precursors of equilibrium 
pure states at lower temperatures 

2 Except in some comments about other papers, we will not refer to metastable states, often proposed as 
responsible for the anomalous dynamical behavior of spin glasses. While we have no argument with this, 
we question the usefulness of the usual practice of inserting metastability by hand, requiring a guess as to 
the structure (usually in state space) and nature of the metastable states. In the treatment presented here, 
metastability may emerge naturally. 
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We consider Glauber dynamics of an infinite EA Ising spin glass starting from an initial 
(infinite- volume) spin configuration cr°. We regard a as chosen from the (infinite tempera- 
ture) ensemble where the individual spins are independent random variables equally likely to 
be +1 or —1. This corresponds to the experimental situation following a deep quench, and 
also (for smaller systems) most numerical simulations. We denote by uj a given realization 
of the dynamics. So there are three sources of randomness in the problem, with realizations 
given by J7", a , and to. All three are needed to determine the spin configuration at time 
t (we take the starting time to be 0). From here on we take J to be fixed. We note that 
the exact choice of spin flip rates plays no role in our analysis at positive temperature, as 
long as detailed balance is satisfied. At T = we consider only the widely used dynami- 
cal rule where flips that are energy lowering (or neutral or raising) occur at rate 1 (or 1/2 
or 0). In all cases, uj can be regarded in the usual way as a collection of random times 
{t x ,i '■ % G Z d , i = 1,2,...) when spin flips are considered (forming a Poisson process for 
each x) along with uniformly distributed random numbers u x ^ that determine if the flips are 
taken. 

We now define a dynamical probability measure u t * T u*\ on the spin configurations, for 
< r(t*) < t*. Given some a , we let the system evolve according to some uj up to a time 
t* — r(t*), after which we average over the dynamics up to time t*. That is, if we denote 
the dynamical (Markov) process as o l = er*(u;) for t > 0, then Vt*,r(t*) is the conditional 
distribution of a e conditioned on {J and cr° and) all (t X) i, w Xj j)'s with t X) i < t* — r(t*). So 
i/ t * = Vt*j» represents a complete averaging over the dynamics (and corresponds to the usual 
dynamical measure — i.e., to the distribution of cr* for fixed J and a ), while Vt*,o represents 
no averaging at all (and hence a single spin configuration). To avoid awkward notation, we 
generally suppress the dependence, which is understood, of v on J, a , uj (up to time t* — r), 
and T. We also note that neither t* nor r depend on jJ, a or uj. In Section ^| we will briefly 
discuss the construction of measures based instead on time averaging for fixed dynamics. 

We can now begin to answer the question, what does it mean for the system to evolve 
or settle into (or "spend all its time inside") a single pure state? Consider the cube Ax of 
linear size L and volume |Ax| (which may be arbitrarily large) centered at the origin. When 
T > (but not at T = 0), we expect that for sufficiently large t* (depending on L) and 
for almost every a , the measure u t * approximates a (possibly mixed, possibly ^-dependent) 
Gibbs state restricted to the cube Ax,. By this we mean that there is some (infinite volume) 
Gibbs state pt* such that for any L and any spin configuration in Ax, the probability 
assigned to by the dynamical measure v t * and that assigned by the equilibrium Gibbs 
measure p t * approach each other as t* — > oo; that is, v t »{a^ L ') — pt*(cr( L )) — ► as t* — > oo. 
More generally, we expect that for almost every cr° and uj, Vt*,r(t*) approximates some Gibbs 
state pt*, T (t*) providing only that r(f) — > oo. 

The notion that, as t* increases, ^t* )T (t*) is increasingly well approximated by some infinite 
volume Gibbs state (possibly depending on t*), may seem surprising — especially in view of 
frequent assertions (see, e.g., Ref. 0) that equilibrium states are of little relevance for the 
nonequilibrium dynamics of infinite systems. In fact, this notion is nothing more than the 
property that for any L and any two spin configurations defined within Ax and 
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agreeing on its (internal) boundary, the ratio ut* tT ((T^)/ut* !T ((T'^) converges to the usual 
finite volume Gibbs expression coming from the EA Hamiltonian. This kind of convergence 
may be expected as it is similar to the conjectured property of Glauber dynamics that only 
Gibbs states are stationary. 

To answer the question posed above about the meaning of settling into a single pure 
state, we now note that if r(i*) also grows sufficiently slowly, then v t * )T ( t *\ shouldP] (for most 
u;'s) approximate a pure (i.e., extremal) Gibbs state p a( **) depending on a and uj (up to time 
t* — r). If on every fixed (and arbitrarily large) lengthscale L this p a eventually becomes 
independent of time (after a timescale depending on L), then the system has settled into the 
pure state a. 

We now present our main results. Unless otherwise indicated, all are for T > and 
are independent of space dimension. Our first result concerns the fully averaged dynamical 
measure v t *. 

3 Evolution of the Dynamical Measure 

Theorem 1. Given some J7", assume that for almost every a , v t * converges to a limiting pure 
Gibbs state as t* — *■ oo. Then is the same pure state for almost every cr°. 

Proof. We use a coupling argument where a single uo is used with two starting spin real- 
izations cr° and a' that differ at only finitely many sites. Then, by the nature of Glauber 
dynamics, there is a positive probability (with respect to the uj's) that the two spin config- 
urations merge after a finite time. Let 9 > represent the probability that the difference in 
configurations disappears by time t . So for t* > t , 

= + (i - , 4° = 6fi t * + (i - e)& , (2) 

where fi t * , fit* , and fi! t * are some probability measures. It follows that for A any (measurable) 
set of spin configurations, 

\4{A)-vf{A)\ < 1-9. (3) 

The same is true with t* replaced by oo, first for A a locally defined event and then, by 
approximation, for general A. The strict positivity of 9 then implies that and cannot 
be mutually singular measures (i.e., living on completely disjoint regions of configuration 
space) and hence®, as pure states, they must be identical. So a change of finitely many 
spins in a doesn't change , and we can then use the Kolmogorov zero-one lawH to 
conclude that the final pure state must be independent of a , o 

Despite the innocuous look of the theorem, it has important consequences. Its conclusion 
is obvious if there exists only one pure state, but it applies equally to the situation where 

3 The tracking of z/ t * T ( t *) by the pure state p a ^ ' is in general weaker than the tracking by p t , T ^ t ,^ in 
that a(t*) may not have a limit and v t » <T u»\(a^ L ') ~ p a ^*\(7^) may tend to zero only in probability rather 
than for almost all u's. We do expect, however, that for almost all u's, p Q< -* - 1 tracks v t *^ T r t *\ for most large 
<*'s (i.e., when domain walls are far from the origin). 
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many pure states exist. Of course, it could logically be that only one pure state is "present" 
(in the sense that the conclusion of the theorem is valid) while other pure states exist but are 
not physically relevant in our dynamical context. (This might even be the case, for example, 
in the EA spin glass with a small nonzero field.) But if the conclusion of the theorem is not 
valid, then only one of two possibilities can occur^: either (1) z/qo is a mixed Gibbs state 
(which may or may not depend on a ), or (2) v t * does not converge as t* — > oo. We note that 
the latter case is already known to occurliZ) in some ID disordered ferromagnets at T = 0; 
on the other hand, if exists and does not depend on cr°, then it would be analogous to 



(and perhaps the same as) pj, the average over the metastate discussed in Ref. |32 



Let's consider each of these two possibilities, taking into account that v t * is the average 
over uj's of Vt*,r{t*)- Possibility (1) implies that although v t * >T {t*) (with properly chosen r) 
is approximately a pure state p a(r) , that pure state depends not only on a (as expected) 
but also on uj. This allows (but doesn't require — see Subsection (4.1| ) the system always 
to "land" in a pure state in the sense that Vt*,r{t*) ~> P a ^ — but then the pure state is 
(almost) never determined solely by a . 

Now, the basin of attraction of a pure state a may be defined as the set of <r°'s such that 
a(a°,uj) = a for almost every uj (see Ref. [T3] for related discussions). We claim that if <r° 
is in the basin of attraction of some pure state, then by a modified version (see below) of 
the coupling argument used in the proof of Theorem 1 , the same will be true after a change 
of finitely many spins in a and so, by the Kolmogorov zero-one law, the set of <t°'s that 
are in some basin of attraction has probability either zero or one. Therefore, if many pure 
states are present (i.e., if a(o~°,uj) is not the same for almost all a and uj), then the union 
of all their basins of attraction must form a set of measure zero in the space of a 's; i.e., the 
configuration space resulting from a deep quench is all "boundary" in the sense that almost 
every initial configuration will land in one of several (or many) pure states depending on the 
realization of the dynamics (if it lands at all). 

The modified coupling argument is as follows. Let <r° and a'° be fixed and let D denote 
the finite set of x's where they differ. Rather than using the same uj for the coupled processes, 
we take an uj — (tx,ii v>x,i) snd an uj' = (t' x j, u' x J that are identical for x outside D but for x 
inside D, they are identical only for times after a 1 and a n merge. For earlier times, uj and 
uj' inside D are independent of each other. If A' is an event defined in terms only of uj' with 
Prob(A') > and M denotes the event of eventual merger of the two processes, then since uj 
inside D may (with small but strictly positive probability) force a merger by a small time e, 
it follows that Prob(A'nM) > 0. Assuming a(cx ,ci;) = a(a°) for almost every uj, we take A' 
to be the complement of the event that a(a'°,uj') = a(a°) so that Prob(A' n M) > would 
yield the contradiction that Prob(a(<7°, uj) = a(o~ )) < 1. It follows that Prob(v4') = and 
so a(a'°,uj') = d(a°) for almost every uj' , which is exactly the claim made in the previous 
paragraph. 

It has been speculated'0 that slow relaxation in spin glasses may be due to points in 
(high-dimensional) state space always being "near" a boundary. What we've shown here 

4 Logically, there is a third possibility that Voo is not a Gibbs state, but this would violate the expected 
behavior discussed in Section || and hence we disregard it (except when T = — see Section || and Ref. [|(| ) . 
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differs in fundamental respects: our conclusion is that almost every point in state space is 
actually on a boundary, and therefore the dynamical consequences are not restricted to very 
low temperatures. 

We note finally that Theorem 1 may be relevant to damage spreading' 
one asks whether the damage (i.e., discrepancy) between o l and o n (with a single u) grows 
as t — ► oo. Theorem 1 suggests that if damage spreading occurs, then v t * doesn't converge 
to a single pure state (e.g., it might converge to a mixed state, as above). 



H< @. where 



4 Local Non-Equilibration 

Before discussing possibility (2), let us consider the physical picture implied by Theorem 1. 
Roughly speaking, some time after an initial quench the system will form domains, whose 
average size increases with time, corresponding to the different pure states. This scenario has 
been analyzed for the two-state droplet pictured EH EE). It is also a well-known scenario 
for coarsening in a ferromagnet following a deep quench®. (Of course, in contrast to the 
spin glass case, one does know how to prepare a ferromagnet in a pure state; for a general 
discussion, see Ref. R33| .) 

In Ref. || it was stated that the infinite homogeneous ferromagnet never reaches equi- 
librium in any finite time (following a deep quench) because the domain sizes (in this case, 
of positive and negative magnetization) increase with time but are never infinite on any 
finite timescale. We do not consider this by itself to be nonequilibration because it does not 
preclude the possibility that on any finite lengthscale, the system equilibrates after some 
finite time, in the sense that after that time domain walls cease to move across the region. 
Instead, we now propose a much stronger version of nonequilibration — the possibility of 
local non- equilibration (LNE) on any finite lengthscale, which is implied by possibility (2) 
and could also occur with possibility (1). We will discuss the difference between these two 
cases of LNE in Subsection but for now will not distinguish between the two. We will 
also discuss below the relation between LNE and persistence exponents!^' Hi 

By LNE we mean that in any fixed finite region, the system never settles down into 
a pure state. That is, domain walls do not simply move farther from the region as time 
progresses, but continually return and sweep across it, changing the state within. More 
precisely, LNE is said to occur unless there is some choice of r(i*) such that for almost all a 
and u, Vt* )T {t*) —* p a ^° ,u) \ a pure state. If LNE occurs, it would force us to revise the usual 
dynamical definitionB of, e.g., the EA order parameter. It could also mean that, for infinite 
systems, time averages and Gibbs averages could agree, despite the presence of many pure 
states. We will return to this in Section |5] after investigating LNE in more detail by means 
of the next theorem, which applies to both homogeneous and disordered systems. 

Theorem 2. If only a single pair (or countably many, including a countable infinity) of 
pure states exists (with fixed J") and these all have nonzero EA order parameter, then LNE 
occurs. 

Proof. Suppose that there exists at T (and for the given J) only a single pair of pure 
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states, and assume that LNE does not occur so that for each o~° and uj, there is a limiting 
pure state a(a°,u). The overlap of a(a°,u) and a(a'°, uj') is 

Q(J,a°,uj,a'°,uj') = lim |A L | _1 Y\ < cr x > a{a o^)< ct x >a(a>o,u>>) , (4) 

where < ■ > a denotes the (thermal) average with respect to the pure state p a . The possible 
overlap values can be only ±qEA and both of these outcomes must have positive probability of 
occurring (as a , uj, cr'°, uj' vary independently to yield a pair of replicas). But the translation- 
ergodicity of each of the distributions from which J , a , uj, a' , uj' are chosen implies the same 
for the joint (product) distribution of {J , a , uj, a' , uj'). Thus, the fact that the overlap Q is 
a translation-invariant function implies that Q must be constant for almost all realizations, 
leading to a contradiction. This argument can be immediately extended to any countable 
number of pure state pairs, o 

This proof also shows that if LNE does not occur (and the limiting pure states a(a°,u>) 
have nonzero Qea)i then almost every (as a , uj, a' , uj' vary) overlap of the pair of pure states, 
a(a°,u) and a(a J0 , uj'), is zero. This leads to: 

Corollary. If LNE does not occur and q&A 7^ 0, then there must be an uncountable 
number of pure states, with almost every pair (in the above sense) having overlap zero. 

This shows that, as stated in the introduction, nonequilibrium dynamics provides impor- 
tant information on the structure of equilibrium pure states. It also suggests a dynamical 
test of the two-state picture: search for chaotic time dependence in Vt* )T {t*)- If LNE does not 
occur, then the two-state picture has been ruled out: there must be an uncountable number 
of states, almost all of which have overlap zero (consistent with the results of Ref. f32|). If 
LNE does occur then neither the two-state nor the many-state pictures have been ruled out. 

How might one go about observing LNE in a spin glass, where, unlike the ferromagnet, 
one doesn't know what a domain wall looks like? Here one can use the clustering property 
that characterizes pure states in general. E.g., a truncated 2-point correlation function of 
the form < a x a > — < a x >< <7 > approaches as \x\ — > oo if the averaging is done in a 
pure state, but not otherwise. In the current context a pure state average corresponds to a 
dynamical average using v t * yT with t <^ t*. In principle one could evaluate this correlation 
function numerically for t* 3> t ^> |x| 3> 1; if it does not approach zero for increasing values 
of these parameters, that would constitute a clear signal of the occurrence of LNE. 

An important consequence of Theorem 2 is that LNE must also occur at positive tem- 
perature in the 2D uniform Ising ferromagnet and the random Ising ferromagnet for d < 4. 
(However, the argument for LNE in random ferromagnet s is not entirely rigorous as there 



is no complete analysis of interface pure states therein. There is though a rigorous proof 
that for the SOS approximation, these states do exist for d > 4 and do not for d < 4; see 
Refs. |,§). 

Moreover, in the 2D homogeneous ferromagnet (on the square lattice) results on LNE 
can be extended to T = 0, in the sense there that a 1 does not converge as t — ► oo; in fact, 
every spin flips infinitely often. The proof (by contradiction) is based on showing that if 
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some spin (say at the origin) remained fixed forever, then (by translation ergodicity and spin 
flip symmetry) so would two spins of opposite sign on the x and y axes. But then there 
would be a domain wall passing through the rectangle determined by these three spins and 
"cutting off" one of them. In every time interval there would be a nonzero probability of the 
domain wall moving to flip that spin, and so with probability one, it eventually would flip. 
For the full proof, see Ref. |30 



It is also shown in Ref. that for many systems cr* does converge to some limit at T = 0. 
This is based on a very general argument that there can be only finitely many flips at any 
site that strictly lower the energy. Examples include spin glasses and random ferromagnets 
where the common distribution of the J X yS is continuous, and either has a finite mean (as 
in most ordinary models) or else is sufficiently "spread out" , as in the highly disordered spin 
glass or ferromagnetic. Other examples are homogeneous ferromagnets (or homogeneous 
antiferromagnets or ±J spin glasses) on lattices with an odd number of nearest neighbors, 
such as the 2D hexagonal lattice or a double-layered 2D square lattice. (There are also 
systems, such as the ±J spin glass on the square lattice, where some spins flip only finitely 
many times and some spins flip infinitely often©.) In light of these results, we restrict the 
term LNE to T > 0, since in the zero-temperature situations where o~ l converges, the limit 
configuration is typically only metastable rather than a ground state and so equilibration has 
not really occurred. In these systems one can define a dynamical order parameter, related 
to the autocorrelation, that does not decay to zero. 

To further clarify the discussion of LNE for the ferromagnet, we note that it is a phe- 
nomenon separate from the spontaneous formation (at positive temperature) of domains 
of, say, the minus phase within the plus phase. That is, on a timescale exponential in L, 
there will form a domain containing the origin (of size L) of the minus phase. Similarly, for 
a finite system of size L, the entire system will flip back and forth between the plus and 
minus phases on a timescale exponential in L. However, this is different from LNE, which 
presumably takes place on time scales of some power of L. Also, the spontaneous formation 
of droplets described above cannot occur at T = 0, but as already discussed, in the 2D fer- 
romagnet the phenomenon of domain walls forever sweeping across any finite region persists 
at zero temperature. 

Since the existence of LNE for all T < T c in the 2D Ising ferromagnet may seem surpris- 
ing, we present a possible physical mechanism for this case which may also shed light on LNE 
in general. The initial spin configuration has (with probability one) no infinite domains. As 
the configuration evolves, some domains shrink and others coalesce. So the origin should 
always be contained in a finite domain, whose size will usually be slowly decreasing, but 
sporadically will have a large change either by coalescing or because a domain wall passes 
through the origin and the identity of the domain changes. Thus LNE is primarily the result 
of nonequilibrium domain wall motion (driven by mean curvature) combined with the com- 
plex domain structure resulting from the original quench. It is also consistent with phase 
separation (as would be expected from equilibrium roughening arguments). In particular, 
the occurrence of LNE does not preclude the divergence with t of the mean scale of the 
domain containing the origin (although for fixed cr° and u, there is a much more complex 
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behavior, as indicated above). 

4.1 LNE and chaotic time dependence 

We noted earlier in this section that LNE can occur in the context of either possibility (1) 
(the fully averaged dynamical measure v t * has a limit, which is a mixed state) or (2) [y t * 
does not converge). That is, LNE must occur if possibility (2) holds, but may or may not 
occur if possibility (1) holds. We now explore further the distinctions between the two cases 
of LNE. 

As described earlier, one way for possibility (1) to occur is if, for some choice of t(£*), 
Vt*, T (t*) ~^ P a<ya f° r almost all cr° and cu, where p a (°~ <^> is some pure state. But it could 
also happen that for any choice of r(t*) << t*, Vt*, T {t*) never settles down to a single pure 
state — so the system is usually in a pure state locally, but the pure state forever changes. 
Nevertheless, a full average over the dynamics (i.e., letting r = £*) still yields a single limit. 
This is to be contrasted with possibility (2), where even the fully averaged measure never 
settles down. 

To clarify these statements, we use the illustration of the 2D homogeneous ferromagnet 
below T c , where we know LNE to occur by Theorem 2. Suppose that possibility (1) occurs. 
Then (for fixed cr° and large time) for approximately half of the dynamical realizations, a 
region of fixed lengthscale L surrounding the origin is in the up state (i.e., the pure Gibbs 
state p + ), and for most of the other half the same region is in the down state (the pure Gibbs 
state p~), and this one-to-one ratio remains essentially fixed after some timescale depending 
on L. Then as t* — > oo, v t * — > p, where p is the mixed Gibbs state (l/2)p + + (l/2)p~. 
Nevertheless, in any given dynamical realization (with averaging done as usual after time 
t* — r, with 1 << t « £*), the region never settles permanently into either p + or p~ . 

By contrast, if possibility (2) occurs, then even the fully averaged dynamical measure 
v t * forever changes. This could happen (again for fixed cr°) if the random dynamics fails to 
sufficiently "mix" the states (in which case one has, given a , some amount of predictive 
power for determining from cr° the likely state of the system in the region for arbitrarily 
large times t*). This is conceivable because even though cr° is globally unbiased between the 
plus and minus states, it does have fluctuations in favor of one or the other state of order 
\J (L*) 2 on lengthscale L*; with L* taken as an appropriate power of t*, these fluctuations 
could (partially) predict the sign of the phase at the origin at time t*. In possibility (1) on 
the other hand, there is a greater capability of the random dynamics to "mix" the states 
which eventually destroys the predictive power contained in the fluctuations of the initial 
state. 

So there are really two kinds of non-equilibration, corresponding either to LNE in the 
framework of possibility (1) ("weak LNE") or else to LNE resulting from the stronger possi- 
bility (2). Because v t * evolves deterministically according to an appropriate master equation, 
its lack of a limit in possibility (2) corresponds to the usual notion of deterministic chaos 
and can thus legitimately be called chaotic time dependence (CTD) If weak LNE occurs, 
this term is not appropriate because here the effect is due to the random dynamics. 
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In our discussion of LNE in the previous section, we do not yet know which of the 
cases correspond to CTD and which to weak LNE. This remains a problem for future 
investigation. However, we note that the occurrence of LNE (but not CTD) in homoge- 
neous ferromagnets (on Z d ) is implicit in the (nonrigorous for d ^ 1) analysis of persistence 
exponentsQ' 0' 0' @ in the sense that the fraction of sites that remain in the same phase 
from time t\ to time t<i tends to zero for 1 << t\ << t 2 . On the other hand, the fact 
mentioned above that the T = analogue of this phenomenon is lattice dependent appears 
to have gone unnoticed. 



5 Time- averaged dynamical measures 

We return to one issue that needs discussion, and will be treated in greater detail elsewhere. 
If LNE occurs (e.g., because only a single pair of pure states is present), would a (long) 
time average of, say, the spin at the origin (or, for the ferromagnet, the magnetization in a 
finite region), give zero? The answer is: not necessarily. It could be that, after long times, 
the system has spent roughly equal amounts of time in both states, in which case the usual 
time average@ (or a discrete average over equally spaced times) would approach zero. But 
it could also happen that, after any long time, the system has spent significantly more of its 
life in one or the other state (which itself would change with the observational timescale). 
In other words (still using the example of a two-state system) , at any long time the weights 
of the two states, as defined by a dynamical measure involving a fixed u and an average over 
uniformly spaced times, could be different from 1/2, and moreover they ma y c hange with 



time. This is analogous to an equilibrium phenomenon discovered by KiilskeEl and seems 
to be exactly what occurs in homogeneous ferromagnets, as reported in recent numerical 
studiesQ. To get a zero average in this situation one would need to average over a sparse 
sequence of increasingly separated times. 



6 Summary 

We have presented a rigorous approach to the dynamics of infinite spin systems which intro- 
duced various dynamical measures on the spin configurations, and considered whether they 
evolve into pure states. We showed that in the case of the EA Ising spin glass with broken 
spin-flip symmetry, one (or both) of two interesting things must happen: either LNE occurs, 
where the system never settles into any pure state (i.e., domain walls forever pass through 
any finite region, causing it forever to change its pure state)Q, or else there exist uncountably 
many pure states, with almost every pair having zero overlap. 

5 LNE may seem somewhat analogous to "weak ergodicity breaking" (see, e.g., Ref. ||) in which the 
system forever moves to different metastable states with increasing lifetimes. There are important differences, 
however: that scenario explicitly requires the system to remain within a single pure state for all time (and 
unlike LNE is supposed to be able to occur even if there is only one pure state), and further makes no 
reference to what is occurring in real space. 
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We proved that the union of the basins of attraction of all pure states (again, if broken 
symmetry occurs) forms a set of measure zero in configuration space; i.e., almost every 
starting configuration is on a boundary between (several or possibly all) pure states. While 
this is also true for the ferromagnet, it obviously is still easy to prepare that system in a 
pure state. But this result has serious dynamical consequences for the spin glass, and not 
only for deep quenches. Because of the possibility of chaotic temperature dependence ||, [16) , 
it is potentially relevant even for small temperature changes made slowly. Experimentally 
observed slow relaxation and long equilibration times in spin glasses may therefore be a 
consequence of small (relative to the system) domain size and slow (possibly due to pinning) 
motion of domain walls. 

More generally, we have argued against a common viewpoint that pure state multiplicity 
is irrelevant to the dynamics of infinite (or very large) systems on finite timescales. A system 
need not — and in several cases, does not — spend all of its time in a single pure state, even 
locally. Because of this, it is also not necessarily true that "absolutely broken ergodicity" 
- i.e., the presence of more than one pure state separated by infinite barriers — implies 
that time averages and Boltzmann averages must disagree (or equivalently, that the limits 
N — > oo and t — > oo cannot commute). Both averages can be zero if for each state the 
(infinite) system locally spends (roughly) equal amounts of time in it and its global flip, 
as discussed in Section [5|. The other possibility is that after almost any long time, the 
system has spent more of its life in one or the other state (which itself would change with 
the observational timescale). If this is the case, the averages should disagree, but due to 
a mechanism different from the standard one. Further development of these ideas, and a 
discussion of their application to experiment, will be presented in a future paper. 
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